Using Computer Vision to Annotate Video-Recoded Direct Observation of Physical Behavior.

Direct observation is a ground-truth measure for physical behavior, but the high cost limits widespread use. The purpose of this study was to develop and test machine learning methods to recognize aspects of physical behavior and location from videos of human movement: Adults (N = 26, aged 18-59 y) were recorded in their natural environment for two, 2- to 3-h sessions. Trained research assistants annotated videos using commercially available software including the following taxonomies: (1) sedentary versus non-sedentary (two classes); (2) activity type (four classes: sedentary, walking, running, and mixed movement); and (3) activity intensity (four classes: sedentary, light, moderate, and vigorous). Four machine learning approaches were trained and evaluated for each taxonomy. Models were trained on 80% of the videos, validated on 10%, and final accuracy is reported on the remaining 10% of the videos not used in training. Overall accuracy was as follows: 87.4% for Taxonomy 1, 63.1% for Taxonomy 2, and 68.6% for Taxonomy 3. This study shows it is possible to use computer vision to annotate aspects of physical behavior, speeding up the time and reducing labor required for direct observation. Future research should test these machine learning models on larger, independent datasets and take advantage of analysis of video fragments, rather than individual still images.

Social skills in neurodevelopmental disorders: a study using role-plays to assess adolescents and young adults with 22q11.2 deletion syndrome and autism spectrum disorders.

BACKGROUNDS: Social skills are frequently impaired in neurodevelopmental disorders and genetic conditions, including 22q11.2 deletion syndrome (22q11DS) and autism spectrum disorders (ASD). Although often assessed with questionnaires, direct assessment provides a more valid estimate of the constructs. Role-plays (i.e., simulates situational settings) therefore appear to be an appropriate indicator of social skills in daily life. METHODS: This co-registered study involved 53 individuals with 22q11DS, 34 individuals with ASD, and 64 typically developing (TD) peers aged 12-30 years. All participants were assessed with role-plays as well as parent-reported questionnaires and clinical interviews focusing on social skills, functioning and anxiety. RESULTS: Both clinical groups showed impaired social skills compared to TD, but distinct social profiles emerged between the groups. Individuals with 22q11DS displayed higher social appropriateness and clarity of speech but weaker general argumentation and negotiation skills, with the opposite pattern observed in participants with ASD. No association was found between social skills measured by direct observation and caregiver reports. Social anxiety, although higher in clinical groups than in TD, was not associated with role-plays. CONCLUSIONS: This study highlights the need to train social skills through tailored interventions to target the specific difficulties of each clinical population. It also highlights the importance of combining measures as they do not necessarily provide the same outcome.

A natural experiment to assess recess frequency on children's physical activity in Arizona (U.S.) elementary schools.

BACKGROUND: In the United States, the number of state policies mandating recess in schools has rapidly increased over the past decade; however, few policies specify recess frequency. Informed by an ecological model of physical activity (PA) policy, this study examined and compared total amounts and intensity of PA expended during recess among children attending schools in compliance with Arizona recess policy ARS§ 15-118 mandating 2 + daily recess periods versus not. METHODS: PA during recess was measured among grade three children (ages 8-10) in four randomly selected elementary schools (two complying averaging 30 daily recess minutes; two non-complying averaging 15 daily recess minutes) in Maricopa County, Arizona. Group-level PA was assessed by direct observation using the System for Observing Play and Leisure (137 observations). A subset of students (N = 134) from all schools wore ActiGraph GT3X + devices during recess to measure individual PA. General linear mixed effects models were used to analyze the impact of recess frequency on group and individual PA during recess. RESULTS: Students attending complying schools spent significantly greater proportions of time in moderate-to-vigorous PA (MVPA) based on direct observation (5%) and accelerometry (15%) and less time being sedentary based on accelerometry (14%) during recess. Across the school day, this would equate to 5.1 more MVPA minutes based on systematic direct observation and 9.5 more MVPA minutes based on accelerometry, and 4.1 less minutes being sedentary based on accelerometry if students received two daily 15-minute recess periods compared to one. CONCLUSIONS: Students attending elementary schools implementing 2 + recesses, in accordance with state policy, demonstrated greater MVPA and less sedentary time, providing preliminary evidence that recess frequency is associated with greater PA intensity among children during recess. Schools that adhere to state-level PA policies may provide a more supportive environment for PA, resulting in increased movement among students. Specifying recess frequency should be considered in statewide recess policy.

Scaffolding Self-Regulated Learning in Operative Dentistry Through Self-Assessment Training.

OBJECTIVES: This study aimed to investigate how effective self-assessment training is in improving the self-regulated learning (SRL) ability of operative dentistry students. The secondary aim was to explore students' attitudes towards self-assessment in clinical settings. INTRODUCTION: Self-assessment has been the focus of dental education research for decades and has been claimed to be cornerstone in the SRL process. METHODS: This is quasi-experimental study conducted at Damascus University Faculty of Dental Medicine, Syria. A modified direct observation of procedural skills (DOPS) assessment protocol with a self-assessment component was applied to a convenience sample of students across five clinical encounters in 2022. Data were collected during clinical training on the DOPS form and at the end of the experiment using a structured questionnaire with a single open-ended question. The qualitative part of the study followed a deductive theory-informed content analysis approach, relying on Zimmerman SRL theory. RESULTS: A total number of 32 students participated in the study, eight of whom were male. During the experiment assessment, participants showed overwhelming positive attitudes towards the utility of self-assessment (m ≥ 3.5; max:4) and the overall assessment method (3.3 ≥ m ≥ 3.5; max:4). Cronbach's alpha for the post-experiment questionnaire was 0.888. A total of 84.4% of the participants strongly agreed that self-assessment is useful in clinical training. Data collected (qualitative and quantitative) from participants revealed the positive effects of self-assessment on all three phases of SRL, especially the reflection phase. CONCLUSION: Self-assessment practice and training showed positive results in terms of improving SRL and performance in a clinical context; SRL appeared to be affected by self-assessment in all phases (forethought, performance, and reflection). Participants' perceptions of self-assessment were generally very positive. These findings imply the potential benefits of applying self-assessment training interventions to foster the SRL ability of learners within the clinical context.

Application of direct observation of operational skills in nursing skill evaluation of pressure injury: A randomized clinical trial.

This was a non-blinded, single-centre, randomized, controlled clinical trial that compared the effectiveness of direct observation of procedural skills (DOPSs)with traditional assessment methods in pressure injury (PI) care skills. The study population included 82 nursing professionals randomly assigned to the study group (n = 41) and the control group (n = 41). Both groups of nurses underwent a 6-month training in PI care skills and were subsequently evaluated. The main outcome variables were the PI skill operation scores and theoretical scores. Secondary outcome variables included satisfaction and critical thinking abilities. Independent sample t-tests and chi-square tests were used to assess differences between the two groups of nurses. The results showed no statistically significant difference in PI skill operation scores between the two groups of nurses (p > 0.05). When comparing the PI theoretical scores, the study group scored higher than the control group, and this difference was statistically significant (p < 0.05). In terms of satisfaction assessment, the study group and the control group showed differences in improving self-directed learning, enhancing communication skills with patients, improving learning outcomes and increasing flexibility in clinical application (p < 0.05). When comparing critical thinking abilities between the two groups of nurses, there was no statistically significant difference at the beginning of the training, but after 3 months following the training, there was a statistically significant difference between the two groups (p < 0.01).The results indicated that the DOPS was effective in improving PI theoretical scores, increasing nurse satisfaction with the training and enhancing critical thinking abilities among nurses.

Implementación del mini-CEX en el pregrado médico: Una experiencia con simulación / Implementation of the Mini-CEX in Medical Undergraduate Education: A Simulation-Based Experience

Resumen La evaluación es un proceso sistemático que resulta en un juicio de valor para tomar decisiones. Los instrumentos empleados para obtener datos sobre el desempeño de los estudiantes requieren de un proceso sistemático y objetivo para su implementación. El mini-CEX es un instrumento de observación directa que ha sido empleado para la evaluación de la competencia clínica en los estudiantes de pre y posgrado desde su invención en 1955. Cuenta con diferentes evidencias de validez para su uso en distintos contextos educativos y clínicos. Permite realizar evaluaciones rápidas, acompañadas de realimentación y que proporcionan información relevante del desarrollo de la competencia clínica. El objetivo de este escrito es exponer la experiencia de la implementación del mini-CEX en el pregrado médico para la evaluación formativa de los estudiantes utilizando la simulación con pacientes estandarizados. Para lograr este objetivo se empleó la siguiente secuencia: búsqueda, planeación, integración y aplicación. Posterior a estos pasos se dan una serie de recomendaciones para la implementación del mini-CEX. Se concluye que la evaluación de la competencia clínica es importante para la mejora continua y permanente de los estudiantes de pre y posgrado. Es necesario sistematizar la evaluación ajustada siempre a objetivos y necesidades específicas de la evaluación.

Abstract Evaluation is a systematic process that results in a judgment to make decisions. The instruments used to obtain data on student performance require a systematic and objective process for their implementation. The mini-CEX is a direct observation tool that has been used for the evaluation of clinical competence in undergraduate and postgraduate students since its invention in 1955. It has different validity evidence for use in different educational and clinical contexts. It allows rapid evaluations, accompanied by feedback and providing relevant information on the development of clinical competence. The objective of this paper is to expose the experience of the implementation of the mini-CEX in the medical undergraduate for the formative evaluation of students using simulation with standardized patients. To achieve this goal, the following sequence was used: search, planning, integration, and application. After these steps we make some recommendations for the implementation of the mini-CEX. Its is concluded that the evaluation of clinical competence is important for the continuous and permanent improvement of undergraduate and graduate students. It is necessary to systematize the evaluation always adjusted to objectives and specific needs of the evaluation.

A comparative analysis of the profile and treatment outcomes of tuberculosis patients managed at the community and primary health care facilities in Botswana.

Background: Successful treatment of Tuberculosis (TB) is necessary for mitigating and averting millions of deaths annually. This study compared the profiles and measured the association between patients, health system-related factors, and TB treatment outcomes of patients managed through the community tuberculosis care model with those managed in primary health care settings. Methods: A retrospective multicenter cross-sectional study was conducted in six districts in Botswana. Patient's records were reviewed using a data extraction sheet, and data not captured on registers were obtained using a structured questionnaire. Results: Three hundred and twenty-four TB patients were sampled. Most participants (84 %; n = 273) were receiving community-based DOT. Patients with moderate TB knowledge (OR 5.3,955 CI 1.01-27.7), good perception of TB care (OR 11, 95 % CI 1.29-94.0), were more likely to enroll for community DOT and achieve treatment cure. Those in businesses (OR 3.85 95 %CI 1.10-22.6), always had treatment available (OR 3.66, 95 % CI 1.12-11.4), never drank alcohol (OR 2.11, 95 %CI 1.06-4.19), used their vehicle (OR 2.11.95 %CI 0.99-4.48) were likely to enroll for community DOT. Conclusion: A patient-specific education program and continuous improvement practices to increase patient TB knowledge and satisfaction should be implemented at all levels to improve treatment outcomes.

Evaluation of a workplace assessment method designed to improve self-assessment in operative dentistry: a quasi-experiment.

BACKGROUND: Dental education has placed continued emphasis on self-regulated learning (SRL) and its subprocess, self-assessment. This study set out to evaluate the effectiveness of a novel workplace assessment method in developing trainees' self-assessment of operative procedures. METHODS: A Direct Observation of Procedural Skills (DOPS) form was modified for the use and measurement of self-assessment. Participants were trained on how to conduct self-assessment using the designed assessment form and its grading rubric. Feedback and feedforward sessions were given to address self-assessment and performance issues. A P-value less than 0.10 was considered significant and the confidence level was set at 90%. RESULTS: Thirty-two Year 5 dental students with an age mean of 22.45 (SD = 0.8) completed five self DOPS encounters during the clinical operative dentistry module in 2022. The aggregated total deviation (absolute difference) between self-assessment and teacher assessment decreased consistently in the five assessment encounters with a significant mean difference and a medium effect size (P = 0.064, partial Eta squared = 0.069). Participants' self-assessment accuracy differed from one skill to another and their ability to identify areas of improvement as perceived by teachers improved significantly (P = 0.011, partial Eta squared = 0.099). Participants' attitudes towards the assessment method were positive. CONCLUSIONS: The findings suggest that the self DOPS method was effective in developing participants' ability to self-assess. Future research should explore the effectiveness of this assessment method in a wider range of clinical procedures.

Factors Associated with Children's Physical Activity During Youth Soccer Practices.

Purpose: To identify practice and social contextual factors that associate with physical activity (PA) levels of children during their participation in a youth soccer program. Methods: Twenty-seven youth soccer teams serving children ages 6-11 years participated. Research staff directly observed and recorded PA intensity and practice and social contextual factors using momentary time-sampling procedures. Each team was observed for 1 practice, during which approximately 6 children were each observed for twenty 30-s observation blocks (10-s observation, 20-s recording). In total, children were observed for 3,102 intervals. Multilevel logistic regression analyses were conducted to describe associations between PA intensity and practice and social contexts. Interaction terms were introduced into the models to determine if the associations differed across girls-only, boys-only, and coed teams. Results: A total of 158 children were observed across the 27 teams. Children were more likely to engage in moderate or vigorous PA while performing fitness (Odds Ratio [OR], 9.9, 95% CI = 5.34-18.04), game (OR, 4.0, 95% CI = 2.88-5.66), warm-up (OR, 2.8, 95% CI = 1.85-4.11), and drill (OR, 1.9, 95% CI = 1.41-2.67) activities compared to tactic/instructional activities. The associations between PA intensity levels and practice and social contexts did not differ across girls-only, boys-only, and coed teams. Conclusions: Fitness activities and full-team game play were associated with higher PA intensity levels during children's participation in youth soccer practices. Youth sport practice protocols can be modified to increase children's physical activity.

Direct observation of spreading precursor liquids in a corner.

Precursor liquid is a nanoscale liquid creeping ahead of the macroscopic edge of spreading liquids, whose behaviors tightly correlate with the three-phase reaction efficiency and patterning accuracy. However, the important spatial-temporal characteristic of the precursor liquid still remains obscure because its real-time spreading process has not been directly observed. Here, we report that the spreading ionic liquid precursors in a silicon corner can be directly captured on video using in situ scanning electron microscopy. In situ spreading videos show that the precursor liquid spreads linearly over time ([Formula: see text]) rather than obeying the classic Lucas-Washburn law ([Formula: see text]) and possesses a characteristic width of ∼250-310 nm. Theoretical analyses and molecular dynamics simulations demonstrate that the unique behaviors of precursor liquids originate from the competing effect of van der Waals force and surface energy. These findings provide avenues for directly observing liquid/solid interfacial phenomena on a microscopic level.

Commentary: Best practices and processes for assessment of autism spectrum disorder - the intended role of standardized diagnostic instruments.

Development of standardized diagnostic instruments has facilitated the systematic characterization of individuals with autism spectrum disorders (ASD) in clinical and research settings. However, overemphasis on scores from specific instruments has significantly detracted from the original purpose of these tools. Rather than provide a definitive "answer," or even a confirmation of diagnosis, standardized diagnostic instruments were designed to aid clinicians in the process of gathering information about social communication, play, and repetitive and sensory behaviors relevant to diagnosis and treatment planning. Importantly, many autism diagnostic instruments are not validated for certain patient populations, including those with severe vision, hearing, motor, and/or cognitive impairments, and they cannot be administered via a translator. In addition, certain circumstances, such as the need to wear personal protective equipment (PPE), or behavioral factors (e.g., selective mutism) may interfere with standardized administration or scoring procedures, rendering scores invalid. Thus, understanding the uses and limitations of specific tools within specific clinical or research populations, as well as similarities or differences between these populations and the instrument validation samples, is paramount. Accordingly, payers and other systems must not mandate the use of specific tools in cases when their use would be inappropriate. To ensure equitable access to appropriate assessment and treatment services, it is imperative that diagnosticians be trained in best practice methods for the assessment of autism, including if, how, and when to appropriately employ standardized diagnostic instruments.

A Direct Observation Form for Evaluation of the Psychiatric Interview: Pilot Testing During the Psychiatry Clerkship.

OBJECTIVES: The authors evaluated the validity of a structured direct observation form (DOF) to assess medical student performance on psychiatric interviews for use in the psychiatry clerkship. METHODS: One hundred and forty-eight third-year medical students were evaluated by two DOFs completed by a supervising resident, fellow, attending, or another team member. One DOF was completed early (time 1) and the other late (time 2) during a 4-week psychiatry clerkship. RESULTS: The DOF showed good internal consistency (Cronbach's alpha = 0.88-0.89). DOFs submitted at time 2 were positively associated with end-of-course clinical grades (p < 0.001); this association remained significant while controlling for time of academic year the course was completed, rater rank, complexity of the case, and difficulty of the interview (time 2 p < 0.001). Mean scores from the DOF were associated with the time of year students took the course with students assessed early in the academic year having lower average scores (p-values = 0.01 at time 1, 0.002 at time 2). Scores on time 1 DOFs were positively associated with rater rank (p = 0.005; residents gave higher scores than faculty). DOFs also correlated with an Entrustable Professional Activity (EPA) assessment of the interview (time 1 r = 0.76, p < 0.001; time 2 r = 0.79, p < 0.001), but not with shelf exam scores (time 1 r = 0.10, p = 0.24; time 2 r = 0.11, p = 0.21). CONCLUSIONS: A brief structured form evaluating medical student performance on psychiatric interviews provided valid information about performance by third-year medical students during the psychiatry clerkship.

Implementation of the SIMPL (Society for Improving Medical Professional Learning) performance assessment tool in the emergency department: A pilot study.

Background: Feedback and assessment are difficult to provide in the emergency department (ED) setting despite their critical importance for competency-based education, and traditional end-of-shift evaluations (ESEs) alone may be inadequate. The SIMPL (Society for Improving Medical Professional Learning) mobile application has been successfully implemented and studied in the operative setting for surgical training programs as a point-of-care tool that incorporates three assessment scales in addition to dictated feedback. SIMPL may represent a viable tool for enhancing workplace-based feedback and assessment in emergency medicine (EM). Methods: We implemented SIMPL at a 4-year EM residency program during a pilot study from March to June 2021 for observable activities such as medical resuscitations and related procedures. Faculty and residents underwent formal rater training prior to launch and were asked to complete surveys regarding the SIMPL app's content, usability, and future directions at the end of the pilot. Results: A total of 36/58 (62%) of faculty completed at least one evaluation, for a total of 190 evaluations and an average of three evaluations per faculty. Faculty initiated 130/190 (68%) and residents initiated 60/190 (32%) evaluations. Ninety-one percent included dictated feedback. A total of 45/54 (83%) residents received at least one evaluation, with an average of 3.5 evaluations per resident. Residents generally agreed that SIMPL increased the quality of feedback received and that they valued dictated feedback. Residents generally did not value the numerical feedback provided from SIMPL. Relative to the residents, faculty overall responded more positively toward SIMPL. The pilot generated several suggestions to inform the optimization of the next version of SIMPL for EM training programs. Conclusions: The SIMPL app, originally developed for use in surgical training programs, can be implemented for use in EM residency programs, has positive support from faculty, and may provide important adjunct information beyond current ESEs.

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions.

In Germany, progress assessments in head and neck ultrasonography training have been carried out mainly theoretically and lack standardisation. Thus, quality assurance and comparisons between certified courses from various course providers are difficult. This study aimed to develop and integrate a direct observation of procedural skills (DOPS) in head and neck ultrasound education and explore the perceptions of both participants and examiners. Five DOPS tests oriented towards assessing basic skills were developed for certified head and neck ultrasound courses on national standards. DOPS tests were completed by 76 participants from basic and advanced ultrasound courses (n = 168 documented DOPS tests) and evaluated using a 7-point Likert scale. Ten examiners performed and evaluated the DOPS after detailed training. The variables of "general aspects" (6.0 Scale Points (SP) vs. 5.9 SP; p = 0.71), "test atmosphere" (6.3 SP vs. 6.4 SP; p = 0.92), and "test task setting" (6.2 SP vs. 5.9 SP; p = 0.12) were positively evaluated by all participants and examiners. There were no significant differences between a basic and advanced course in relation to the overall results of DOPS tests (p = 0.81). Regardless of the courses, there were significant differences in the total number of points achieved between individual DOPS tests. DOPS tests are accepted by participants and examiners as an assessment tool in head and neck ultrasound education. In view of the trend toward "competence-based" teaching, this type of test format should be applied and validated in the future.

Taste agents as modulators of the feeding behaviour of grazing yaks in alpine meadows.

Feeding behaviour plays a significant role in promoting good animal health and welfare. It is also reflective of the quality and quantity of available feed. In fact, grazing livestock do not select their feed randomly, rather their behaviour is influenced by the texture, taste, and smell of each pasture species. Although taste agents are often used to modify feed intake for captive livestock, the effect on the feeding behaviour of grazing livestock has not yet been extensively evaluated in native grasslands. To address this gap in knowledge, herein, we sprayed three types of taste agents-salty (SA), sweet (SW), and bitter (BT)-on alpine meadows to investigate their effect on the grazing behaviour of yaks (Bos Grunniens) on the Qinghai-Tibetan Plateau (QTP). Behavioural observations showed that grazing was concentrated primarily in the morning and afternoon, while ruminating/resting peaked at noon; however, the diurnal behavioural patterns of grazing yaks were not affected by the taste agents. Application of the SA agent significantly increased the yaks' grazing time, bites per minute, bites per step, time per feeding station, and steps per feeding station, while significantly reducing walking time, steps per minute, and number of feeding stations per minute. Meanwhile, application of the SW agent significantly increased the yaks' time per feeding station, however, significantly reduced the steps per minute and number of feeding stations per minute. In contrast, the BT agent significantly increased the yaks' walking time, steps per minute, and number of feeding stations per minute, while significantly reducing grazing time, bites per minute, bites per step, and time per feeding station. Application of the SA agent also significantly increased the intake of favoured, edible, and inedible forage, while the SW agent improved inedible forage intake, however, had a more subtle effect on favoured and edible forage intake. Meanwhile, the BT agent had an inhibitory effect on grazing intake. Hence, the structural equation model suggested that taste agents may directly or indirectly influence grazing behaviour by regulating feeding behaviour. Our findings provide a theoretical basis for using taste agents in grasslands to control the grazing behaviour of livestock and provide a method to promote the stability of grassland communities, while mitigating the degradation of grasslands in the QTP.

Health care workers' experiences of video-based monitoring of hand hygiene behaviors: a qualitative study.

BACKGROUND: Hand hygiene is key to preventing health care-associated infections. Human observation is the gold standard for measuring compliance, but its utility is increasingly being questioned with calls for the use of video monitoring approaches. The utility of video-based systems to measure compliance according to the WHO 5 moments is largely unexamined, as is its acceptability amongst health care workers (HCW) and patients. This study examined HCW acceptability of video monitoring for hand hygiene auditing. METHODS: Following trial of a video monitoring system (reported elsewhere), 5 participating HCW attended 2 in-depth group interviews where they reviewed the footage and explored responses to the approach. Transcripts were analyzed using thematic analysis. RESULTS: Four themes were identified: 1) Fears; 2) Concerns for patients; 3) Changes to feedback; and 4) Behavioral responses to the cameras. HCWs expressed fears of punitive consequences, data security, and confidentiality. For patients, HCWs raised issues regarding invasion of privacy, ethics, and consent. HCWs suggested that video systems may result in less immediate feedback but also identified potential to use the footage for feedback. They also suggested that the Hawthorne Effect was less potent with video systems than human observation. CONCLUSIONS: The acceptability of video monitoring systems for hand hygiene compliance is complex and has the potential to complicate practical implementation. Additionally, exploration of the acceptability to patients is warranted. CHECKLIST: COREQ.

Examining Processes of Care Redesign: Direct Observation of Group Well-Child Care.

We sought to describe processes of psychosocial screening and discussion with immigrant Latino families in the context of group well-child care. We conducted longitudinal direct observations of the 1-, 2-, 4-, and 6-month visits of 7 group well-child care cohorts at an academic pediatric clinic using unstructured observations of visit and group processes as well as structured observations to code facilitators' behavior. A range of psychosocial and social determinants of health topics were incorporated into discussions. In general, providers skillfully navigated group discussions, but inconsistently introduced the visit purpose. Asking participants to define psychosocial terms (eg, stress) and conversations about managing fussy infants were effective strategies to engage families in psychosocial discussions (eg, about postpartum depression). Some challenges with workflow were identified. Strategies to enhance screening and discussion of psychosocial topics may benefit from adaptation to maximize the effectiveness of this care mechanism.

Evaluating Modes of Observations Using Hierarchical Signal Detection Rater Models.

Scoring of performance can be based on different modes of observation, which can include live and videotaped observations. Although live observations have been the traditional format of measuring examinee performance in education and in healthcare, videotaped observations provide educators and testing agencies the promise of unbiased and standardized evaluations, offering practical solutions to limitations of real-time scoring. This study proposes a measurement model taking into account different modes of observation, using an extension of the hierarchical rater model based on signal detection theory (HRM-SDT). A hierarchical rater model is motivated by the nested structure of scores assigned by raters - scores assigned by raters become indicators of performance quality, which in turn become indicators of examinee ability. This study extends the hierarchical structure of the scoring process to include modes of observation, which serves as an intermediary level between the latent categorical indicator of performance quality and examinee ability, forming a three-level HRM-SDT. Analyses based on real-world data showed differences in the quality of scores from live observations and videotaped recordings. Compared to the traditional HRM-SDT, the overall model fit improved when including modes of observation. Simulations using different sample sizes and conditions provide implications for uses of this model.

Real-time monitoring of polyacrylamide gel electrophoresis by the shadowgraph technique.

Polyacrylamide gel electrophoresis (PAGE) with sodium dodecyl sulphate (SDS) and Coomassie brilliant blue (CBB) staining is widely used in protein research and requires time for electrophoresis, staining and destaining. Because the protein bands electrophoresed in the gel are invisible in most cases, the results cannot be observed until the whole process is complete. In this study, shadowgraph was applied to detect biomolecules such as proteins during electrophoresis. A simple optical system and camera-enabled real-time monitoring of migration and separation of individual protein bands in polyacrylamide gels without staining. The visibility was high enough that it was possible to visualize substances other than proteins, such as DNA. This method provides protein profiles instantly in the early stage of electrophoresis. The elimination of the staining and destaining steps will help save researchers' time. The method is also environmentally friendly and will help reduce the generation of waste solutions containing synthetic dyes.

Application of Mini-Clinical Evaluation Exercise combined with direct observation of procedural skills in standardized training of emergency medicine guided by professional physician qualification examination / 中华医学教育探索杂志

Objective:To investigate the application effect of Mini-Clinical Evaluation Exercise (Mini-CEX) combined with direct observation of procedural skills (DOPS) in standardized training of emergency medicine guided by professional physician qualification examination.Methods:Based on the time of emergency medicine teaching reform in Ruikang Hospital Affiliated to Guangxi University of Chinese Medicine, 32 standardized training residents in Emergency Department before September 2020 were included as control group and were given traditional teaching, and 32 standardized training residents after September 2020 were included as observation group and were given Mini-CEX combined with DOPS teaching under the guidance of professional physician qualification examination. The two groups were compared in terms of Mini-CEX score, DOPS score, assessment score of comprehensive emergency skills, pass rate of professional physician qualification examination, and comprehensive teaching quality. SPSS 25.00 was used to perform the t-test and the chi-square test. Results:Compared with the control group after training, the observation group had significantly higher scores of Mini-CEX, DOPS, and comprehensive emergency skill assessment ( P<0.05). There were no significant differences between the two groups in the pass rates of theoretical and practical examinations in professional physician qualification examination, and the observation group had a significantly higher total pass rate than the control group ( P<0.05). The observation group had significantly higher comprehensive teaching quality scores than the control group ( P<0.05). Conclusion:Mini-CEX combined with DOPS guided by professional physician qualification examination can help to improve the teaching effectiveness of standardized training residents in emergency, enhance their comprehensive skills and emergency professional skills, achieve a relatively high pass rate of professional physician qualification examination, and improve their post competency, and thus it holds promise for clinical application.